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Abstract 

Large deviation principles are established for the Fleming- Viot processes with neutral mu- 
tation and selection, and the corresponding equilibrium measures as the sampling rate goes to 
0. All results are first proved for the finite allele model, and then generalized, through the 
projective limit technique, to the infinite allele model. Explicit expressions are obtained for the 
rate functions. 
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1 Introduction 

The Fleming- Viot process is a measure- valued process describing the evolution of the distribution of 
genotypes in a population. In the case of two alleles it reduces to a one-dimensional diffusion process 
that approximates the classical Wright-Fisher model. The standard model in population genetics 
involves mutation, replacement sampling, and selective advantages among various genotypes. 

Let E be a compact metric space, C(E) be the set of continuous functions on E, and Mi(E) 
denote the space of all probability measures on E with the topology of weak convergence. Let A be 
the generator of a Markov process on E with domain D(A). Define V = {F : F(pi) = /((/«, (f>)), f G 
C%°(R),(f> G D(A),fj, G Mi(E)}. Then the generator of the Fleming- Viot process is 

£F( "> = + yMmm) Ql » ,bM (L1) 

= f'{{v,4>)){v,A4>) + |y J (fr{x)(l>{y)Q{n;dx,dy), 
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where 



5F^)/5^x) = lim e- l {F{^ + e5 x )- F{^)}, 

e— 5>0+ 

8 2 F(fi)/8fji(x)8fji(y) = lim ( £l e 2 )~ 1 {F( i i + £l S x + e 2 ^) - F(/x)}, 

ei->0+,e 2 ->0+ 

da;, dy) = fj,(dx)S x (dy) — fj,(dx)fj,(dy), 

and 5^ stands for the Dirac measure at a; G E. The domain of £ is V. E is called the type space, 
A is known as the mutation operator, and the last term in (1.1) describes the continuous sampling. 
If the mutation operator has the form of Af(x) = | J(f(y) — f(x))i>o(dy) with vq £ Mi(E), we 
call the process a Fleming- Viot process with neutral mutation. It is known that the Fleming- Viot 
process with neutral mutation has a unique reversible probability measure (cf. Ethier and Kurtz 
[6])- 

In the present article we will consider the limiting behavior of this process as 7 — ► 0. In the 
first principal result we establish a large deviation principle (henceforth, LDP) for the sequence of 
reversible measures. It turns out that the sequence converges to the probability fixed point vq of 
the mutation operator exponentially fast and for 9 = l,z/ <C vq the deviation is characterized by 
the relative entropy defined as 

tt ( \ \ \ I E hl °Shdp if 1/0 < v 

H{vq\v) = I _ (1.2) 

I 00 otherwise, 

where h is the Radon-Nikodym derivative of vq with respect to v. It is known, by Sanov's theo- 
rem, that the empirical measure Ylk=i $x k }n>i of an i.i.d. sequence of random variables with 
common distribution vq converges exponentially fast to vq as n goes to infinity, and the deviation 
is characterized by the relative entropy H{v\vq). Our example here may be the first among the 
large deviation literature that has this "reversed" form of relative entropy as rate function. In 
Sanov's theorem, the influence of sampling is dominant while in the Fleming- Viot case this influ- 
ence decreases to zero. This may be an explanation for the "reversed" expression of the two rate 
functions. 

The second principal result of this article establishes a path level LDP for the Fleming- Viot 
process with neutral mutation and with selection. This can be viewed as an Freidlin-Wentzell 
type result in infinite dimension. Furthermore, the existing results on large deviations for finite 
dimensional diffusions usually assume either the diffusion coefficient is non-degenerate or the square 
root of the diffusion coefficient is uniformly Lipschitz continuous, but our model with finite alleles 
satisfies neither of them. Hence our results also include an extension of the finite dimensional 
Freidlin-Wentzell theory. 
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The sampling rate 7 can be interpreted as the inverse population size and the large deviation 
results of this paper describe the deviations from the "infinite population" deterministic limit. 

The large deviation result for equilibrium measures is proved in Section 2 and the path level 
LDP is proved in Section 3. We will first prove the LDP for the Fleming- Viot process with neutral 
mutation, and then, by the Cameron-Martin-Girsanov transformation, for the case with selection. 
For processes without selection we will first prove the result for the finite allele model, and then 
generalize, through the projective limit technique, to the infinite allele model. 

2 LDP for Equilibrium Measures 

Let the following objects be given: X a Hausdorff topological space, Bx a u-algebra of space X , 
{P e } e >o a family of probability measures on (X, Bx), {«e} e >o a family of positive numbers tending 
to zero as e goes to zero, and a function / : X — > [0, 00]. 

Definition 2.1 The function I : X — ► [0, 00] is called a rate function if it is lower semicontinuous. 
A rate function is called the good rate function if for any r > 0, the level set 3>/(r) = {x £ X : 
I(x) < r} is compact. The constant a £ is called the speed. 

Definition 2.2 {P £ } satisfies a LDP with the rate function (or good rate function) I if 

1. for each Bx -measurable open subset G of X 

liminf a £ logP £ (G) > - inf I(x); (2.1) 

e-S>0 x£G 

2. for each B x -measurable closed subset B of X 

limsupa e logP e ( J B) < - inf I(x); (2.2) 

Remark: The £>x- measu rable condition is needed when B is not the Borel u-algebra and not all 
open or closed sets are £>x- measu rable. This situation may occur when the space X is not separable. 
When the space X is compact, all rate functions are good rate functions. Also the function / in 
the above definition is unique when X is a regular topological space. For an excellent introduction 
to basic concepts and techniques of large deviations refer to [4]. 

In this section we will establish LDP for the equilibrium measures of the Fleming- Viot processes 
with neutral mutation and with selection. We will start with the case when the type space E is 
finite. Then, by using the projective limit technique, we obtain results for the case of E = [0, 1]. 
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For any n > 1, let E = {1, 2, • • •, n}. The space Mi(E), the set of all probability measures on 
E, can be identified with the (n — l)-dimensional simplex 

n 

A n = {x = (x u ■ ■ -,x n ) : x t > 0, i = l,---,n; J2 Xt = 1 }- 

i=l 

The Fleming- Viot process with neutral mutation reduces to the neutral one-locus ra-allele diffusion 
process with generator 

A 2 ^, Xl{5l] ~ Xl) dx~dx~ ' J ' '' )jJ7' 

1,3 = 1 « = 1 3 = 1 

where qji(j / i) is the intensity of a mutation from allele j to allele i, and gjj = — J2i^j Qji- 

Let to denote the Lebesgue measure on A n . If the infinitesimal matrix is irreducible, then 

this diffusion has a unique stationary distribution which is absolutely continuous with respect to 

to. (cf. Shiga [11]) 

In the special case of parent-independent mutation, i.e., 

9 n 

Wright [14] discovered that for p = (pi, • • • the unique stationary distribution He,-y, P G Mi(A n ) 
is the Dirichlet distribution with parameters pi, ■ ■ ■ ,p n given by 

n / j \ rb 7 " 1 ^] 7 -ig pl _i 7 -ig Pn _i , , 

e ' lA > ~r{ 1 - 1 0p 1 )---F{ 1 - 1 0p n ) Xl "' Xn ax 1 ---ax n _ 1 . 

For any Borel measurable subset C of A n , we have by Stirling's formula 

-la 1 "7 



logn,, 7 , p (C) = log{— = \ \ J tl T^TT (2-3) 

7 _1 epi-i 



X / X x 



n-1 1 1 (Opt) ■ ■ ■ (0p n ) 7 r «i a„ 
lo g7T7Z+ o lo S B + TTT7T « 



2 ° 277T 2 ° 6 126 L pi p„ 

where < «,«!,•••,«„ < 1 are some constants. 

For any e > 0, let C e = {a; £ C : mini< 8 < n X{ > e}. For any measurable function / on 
A ni \\f\\ L1 -i denotes the L 1 1 norm of / with respect to measure to. Then we have for 7 < 
mini< 8 < n {%}, 

\\I c e^li ep < l °z x <\\ r = [[ x[ H ' Px ■■■xl~ lepn dx l ---dx n _ l \ 1 (2.4) 



c 
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<[ / x\ l6vi ~ l ■■■xl l9 -P"- l dx l ---dx n _ l \< = WlceT.lri^)^ 
Jc 

<\\i As e £r =1 on 1 1 + m{ c \ Ce ) 

£ 

< i |/ ce Er=i ios^ 1 1 + m{ c \ Ce) . 



Letting 7^0, then e — ► 0, we get 

lim[ / x 1 ~ l6pi - 1 ■ ■■xl~ lepn - 1 dx 1 ■ ■■dxn-t] 1 = ess sup{I c e^=i ^i°s^ : x e A n }. (2.5) 
For any subset _B of A n , we have 

ess sup{/ B e£r=i e K log:E8 : a; G A n } < e" inf * 6S * p< log ^ . (2.6) 
On the other hand for any open subset G of A n , 

ess sup{/ G e£r=i e « lo s^ : a; G A n } = ess sup{e£r=i 6 ^ lo s^ : x £ G} (2.7) 

By (2.3), (2.5), and (2.6), we get that for any closed subset B of A n 

n ^ 

lim sup 7 log Ug }1}P (B) < -0 inf {V(p 8 log \-p t logp t )}. (2.8) 

7^0 ^e-B i=1 Xi 

From (2.3), (2.5), and (2.7), we obtain that for any open subset G of A n 

n l 

liminf 7 log n^^G) > -9 inf {V(p 8 log hp 8 k>gp 8 )}. (2.9) 

7->0 xeG X{ 

Note that in the present situation the relative entropy H(p\x) of p with respect to x is given by 

n 

H(p\x) = ^2 pi log— , 
i=i Xt 

and is non-negative, continuous. This combined with the compactness of A n implies that all level 
sets of {x G A n : H(p\x) < r} are compact. Thus we have proved the following theorem. 

Theorem 2.1 When the mutation is parent independent, the family {n# j7j p} 7> o satisfies a LDP 
on space A n with the good rate function I 6 p {x) = 6 H(p\x) as 7 goes to zero. 

Remark: It is well known that the relative entropy H(x\p) is the rate function describing the 
large deviations of the empirical measure of an i.i.d. sequence of random variables with common 
distribution p. In the case of 9 = 1 the rate function in Theorem 2.1 has an "reversed" expression 
H(p\x). 
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In Theorem 2.1, the probability measure p is positive for every type i in E. By making X{ = 
whenever pi = 0, the Dirichlet distribution can be defined for any p £ A n as follows. Without loss 
of generality, let p = (pi, • • • , p r , 0, • • • , 0), r < n,p = (pi, • • • , p r )- We define 



n e , 7 , P = n e , 7iP -xC" r - (2-io) 



For any p,x £ A n , define 



a 6H(p\x) if a; <C » 

= , (2-H) 

I oo otherwise, 

Then a generalized version of Theorem 2.1 can be stated as follows. 

Theorem 2.2 For any p £ A n , the family {n# j7j p} 7> o satisfies a LDP on space A n with the good 
rate function I 6 p {x) as 7 goes to zero. 

Next we consider the case when the type space E = [0,1]. Let Mi ([0,1]) be the collection 
of all probability measures on [0, 1] with the topology of weak convergence. Another topology on 
Mi([0, 1]) needed in the sequel is called the r topology which is the smallest topology such that 
for each bounded measurable function / on [0, 1], the map fi — ► Jq f{z)fi{dz) is continuous. The 
r-topology on Mi([0, 1]) is stronger than the weak topology. But when the type space E is finite, 
the two topologies coincide with each other. We use M^([0, 1]) to denote the space of all probability 
measures on [0, 1] equipped with the r topology. 

Note that for each x £ [0,1], let V x = {(J, £ Mi ([0,1]) : fi{x) > 3/4}. Then each V x is 
an nonempty open set in the r topology and for different x,y £ [0,1], V x and V y are disjoint. 
Since there are uncountable number of such open sets, the space M-^fO, 1]) is not separable. The 
(T-algebra B T on Mi"([0, 1]) is defined to be the smallest <7-algebra such that for every bounded, 
measurable function / on [0,1], the map fi Jq f(x)d [J,(x) is measurable. It is known (cf. [4]) 
that the Borel u-algebra of space Mi([0, 1]) is the same as B T . We use B to denote this common 
ex-algebra throughout the remainder of this section. 

Let 

V = {{-Bi, • • • , B r } : r > 1, B\, ■ ■ ■ , B r is a partition of [0, 1] by Borel measurable sets} (2.12) 

be the collection of all finite partitions of [0,1]. For any fj, £ Mi([0,l]),j = {B\, ■ ■ ■ , B r } £ V, 
define k^/i) = (/i(-Bi), • • • , fi(B r )). 

For any fj,, v £ Mi([0, 1]), let H(pi\v) be the relative entropy of fj, with respect to v defined in 
(1.2). Then it is known (cf. [5]) that 

H(n\v) = sup { / gdfi — log / e 9 dv} = sup { / gdfi — log / e 9 dp} 1 (2.13) 
gee ([0,1]) Jo Jo g eB([o,i]) Jo Jo 
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where C([0, 1]), B([0, 1]) are the sets of continuous functions and bounded measurable functions on 
[0, 1], respectively. 

The following expression of the relative entropy will be repeatedly used in the sequel. 
Lemma 2.3 For any /2, v £ Mi([0, 1]), 

H( M |z/) = SUpH(7T>)|7T>)). (2.14) 

Proof: If n is not absolutely continuous with respect to is, then both side of (2.14) are infinity. Now 
we assume that h = ^ exists. Then for any j = (B\, • • • , B r ) £ V, choose a function g £ -B([0, 1]) 
such that 

9(*)= E log^/*^). 

By direct calculation we have 

H(n 3 (»)\n 3 (v)) = f 1 g(z)d» -log (\Mdv. 

Jo Jo 

By (2.13), we get H (it 3 (pi)\iT 3 (v)) < H(pi\v) which implies that sup je ^ H (ir 3 (]-i) \if]{y)) < H(pi\v). 
On the other hand, for any n > 1, let 

h n {x) = J2(k~ l)/2 n lB k (x) + nI An (x), 
k=l 

where B k = {z : (A;-l)/2 n < h(z) < k/2 n }, A n = {z : h(z) > n}. The fact that h is integrable with 
respect to v implies that h n is an increasing sequence of nonnegative simple functions converging 
to h almost surely with respect to v. Let I = {B\, • • • , -B n 2"j A n }. Then we have 

SUpif (7^)1 7Tj(z/)) > H{-Kl{jl)\TTl{v)) > f h n \ogll n dv. 

jer Jo 

Let n go to infinity, we get (2.14) by (1.2) and the monotone convergence theorem. □ 
Now we are ready to prove large deviation results for equilibrium measures of some Fleming- 
Viot processes. A Fleming- Viot process with neutral mutation has a generator of the following 
form: 

where E = [0, 1], > 0, u £ Mi([0, 1]), and 

Af(z)= e -j\f(y)-f(z))Mdy), 
Q(fj,; dz, dy) = ji(dz)8 z (dy) — fj,(dz)fj,(dy). 
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For any symmetric bounded measurable function V(z, y) £ B([0, 1] X [0, 1]) , let 

Jo Jo 

and 

{ ^T' % ] = Jo Jo J! % {z)[v{Zi y) ~ v{Vi w)] M^)M^)M<H- 

Then the generator of a Fleming- Viot process with neutral mutation and selection takes the 
form: 

£ v-F(, 1 )=£F(,0 + (^,^>, (2.16) 

where V is called the fitness function. 

It is known (cf. theorem 3.1 and theorem 3.2 in [6]) that the martingale problem associated 
with generators L and Cy are well-posed. Shiga [12] shows that the Fleming- Viot process with 
generator L has a unique, reversible stationary distribution Tlg tltl s G Mi(Mi([0, 1])), which is the 
distribution of a Mi([0, l])-valued random variable v characterized by the property that whenever 
r > 2 and Bi, • • • , B r is a partition of [0,1], (z/(_Bi), • • • , v(B r )) has the Dirichlet distribution 
with parameters ^6vo{B\), • • •, ^6vo{B r ). (Note that zero parameters can be removed to create a 
Dirichlet distribution on a simplex with dimension less than r.) The Fleming- Viot process with 
neutral mutation and selection also has a unique, reversible stationary distribution given by 

ne, 7 , ! y ,y(rf / u) = Z~ x exp[^-^-]H d:1:1Jo (dfi), (2-17) 

7 

where Z is the normalizing constant. (cf. Ethier and Kurtz [7]). 

Theorem 2.4 The family {n# j7j j, } satisfies a LDP on space M^([0, 1]) with the good rate function 

4m = { m{v ^ ] tffl<<P ° (2-18) 

I oo otherwise, 

Proof: First note that the set of all finite partitions V, partially ordered by j y i iff j is finer than 
t, is a partially ordered right-filtering set. For every j = (Bi, • • • , B r ) £ V, let 

r 

X i = i x = ( X B! x B r ) ■ x Bt > 0, i = 1, • • • , r; ^ x Bt = 1}. 
For any % = (C\, ■ ■ -,C/), j = (B t , ■ ■ •, B r ) G V, j y t, define 

n tJ :X J ^X t ,(x Bl ,---,XB r )^( x B k r ' ' ' XB k)- 
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Let X represent the projective limit of the family {X 3 ,tt 13 ,x,j G J,y}, n 3 be the projective 
mapping. Then we have Mi([0, 1]) C X by identifying fj, G Mi([0, 1]) with the projective limit of 
{( f i(B 1 ),---,fi(B r )):j=(B u ---,B r )eV}. 

On the other hand, any element fj, of X can be viewed as a finitely additive measure on [0, 1]. 
For any / G C([0, 1]) and fj, G X, we define the following "abstract integral" of / with respect to fj,: 

<^/) = i™ 2 E/( 2 "^)^' 

k=0 

where B = [0,2" n ), B k = (2~ n k, 2~ n {k + 1)] for k = l,---,2 _n - 1. The existence of this limit 
is guaranteed since YllJo 1 f(2~ n k)xB k is a bounded Cauchy sequence. From this definition and 
the fact that any decreasing sequence f n G C([0, 1]) which converges to zero pointwisely converges 
to zero uniformly (Dini's theorem), we conclude that (/i, /) is a linear form on space C([0, 1]) 
satisfying: 

(a) (/z, /) > for / > 0; 

(b) ( M ,/) = lfor/=l; 

(c) (/i, /) — ► as / | pointwise. 

By the Daniell-Stone theorem (see e.g. page 197 of Bauer [1]), fj, is a probability measure on 
the Borel <7-algebra of [0, 1]. The projective topology obtained is just the r-topology. Hence we 
have X = MT([0, 1]). By Theorem 2.2 and Theorem 3.3 of Dawson and Gartner [3], we have that 
the family {ng j7jJ/0 } satisfies a LDP on space X with the good rate function 

/( M )=sup{/^ M (7r>)):jGP}- (2-19) 

From (2.3), we see that I(fi) = I b Vq (fj,). □ 
Now let 

C(6,u ,V)= sup {V(fi)-lZ (fi)},lk v (fi) = C(6,u ,V)-[V(fi)-lZ ( f i)]. 

A*eMi(s) 

Then we have the following LDP. 

Theorem 2.5 The family {He tlt v 0t v} satisfies a LDP on space Mi([0, 1]) with the good rate func- 
tion I^ v (fi). 

Proof: Since C(9, vo, V) is a constant, V{pi) is bounded continuous in the r-topology, any level 
set of function (/i) is a r-closed subset of a level set of function 1^ (/i). Hence (/i) is a good 
rate function in the r-topology, and thus in the weak topology too. 
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By using Varadhan's Lemma, we have for any F(pi) £ C(Mi([0, 1])), 

lim 7 log Z = lim 7 log / e v ^^H e , 1 ,, (dfi) = C(0, v ,V), 

7^0 7^0 JMi([0,l]) 

lim 7 log / e^'me^yidfi) = C(9,u ,F + V) -C(9,u ,V). 

7^0 JMi([0,l]) 

Since Mi([0, 1]) is compact and thus the family Tlg a ^ y is exponential tight, by Bryc's inverse 
Varadhan Lemma (cf. section 4.4 of Dembo and Zeitouni [4]), we get that the family {He tlt v 0t v} 
satisfies a LDP on space Mi([0, 1]) with the good rate function I^ v (fi). □ 

3 Path Level LDP 

In this section we will establish three LDPs at the path level: LDP for finite type (or allele) model, 
LDP for the Fleming- Viot process with neutral mutation, and LDP for the Fleming- Viot process 
with neutral mutation and selection. The novelty of our result for finite type model is that the 
diffusion coefficient of the corresponding diffusion process is degenerate and the square root of the 
diffusion coefficient is non-Lipschitz. This is an extension of the Freidlin-Wentzell theory. 

3.1 LDP For Finite Allele Model 

Define 

n-l 

S n = {x = (xi, ■ ■ ■ , x n _i) :xi>0, i = 1, • • • , n - 1; ^ x t < 1}. 

8 = 1 

The Fleming- Viot process with finite allele and neutral mutation is a finite dimensional diffusion 
process described by the following system of stochastic differential equations 

n-l 

dx £ k (t) = b k (x £ (t))dt + eJ^^kiix^t^dBiit), 1 < k < n - 1, (3.1) 

;=i 

where x £ (t) = (x\(t) , ■ ■ ■ , x^^t)) , b k (x £ (t)) = |(p fc - x e k (t)), and cr(x £ (t)) = {<7kl{x £ {t)))i< k ,i< n -i 
is given by 

a{x e {t))a'{x e {t)) = D{x £ {t)) = (x £ k (t)(5 kl - zf (t)))i< fc ,K n _i, 

and e 2 = j,p k = vo(k) > 0, Bi(t) , 1 < / < n — 1 are independent Brownian motions. 

For a fixed T > and x G S n , let C([0, T],S n ) be the space of all <S„-valued continuous functions 
on [0,T] endowed with the uniform topology, and P £ denote the law of x £ (-) starting at x. 

Lemma 3.1 The family {P^} e> o is exponentially tight on C([0,T],S n ) for all x £ S n . 
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Proof: Let c\ > sup^g^ ||6(a;)||, c 2 = sup||g|| =1 }X ^s n {0, D{x)6) > 0. For any a > 0, choose too > 
l,So > such that for to > mo,s < So, we have 2(ra — 1)to 2 T > 1 and as~ 2 > 1. Define 

{s(-) £ C([0, T],S n ); sup | a; (i) - x(s)\ < p m }, 

m 

where 7 m = p m = c x ^ m + {2c 2 (ra - 1)4^ + 7m In 2( "^ 1)T ]} 1/2 - Let b(x) = (b^x), ■ ■ ■ , b n _i(x)). 
Then we have 



P e A<-)^K)< E p { su p \x e {t)-x s { s )\> Pm } 

m=m t,se[0,T],\t-s\<'ym 



< E P { SU P |a; e (f) - £ e (s) - / b(x £ (T))dT\ > p m - c^} 

m=m t,sG[0,X],|t-s|<7 m 

^ 2(n-l)T / (p m - ci7 m ) 2 

< 2^ ex Pl 



m=mo 

CO 



2c 2 (ra - l)7 m e 2 



E ^ r ^exp(--^(l/TO + 7 m ln(2(n-l)r/7 m )) 



m=mo 

oo 



. exp(-£) 



(3.2) 



" m ^ 7 m { 2(n-l)T> Pl 7 J " l-exp(-£)' 

where the third inequality is obtained by using Theorem 4.2.1 in Stroock and Varadhan [13]. Letting 
e go to zero, we get 

limsupe 2 logP|{/^} < -a. (3.3) 

e-»0 

The lemma follows since K a is a compact set in C([0, T], S n ). □ 
Let dS n and S° denote the boundary and interior of S n , respectively. By direct calculation we 
get det(A(x)) = x\ ■ ■ -x n _\{\ — Y^iZi x i)- Thus for any x £ S°, D(x) is invertible and the inverse 
is given by 



1 



D~ 



1 



Kz<n — l,i^n — 1 
^n— 1 



(3.4) 



where 



1 E;=i ^i- 
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For any x in S n and ip in C([0, T], S n ), let 

HI = W ■ ¥>(*) = * + f g{s)ds, g e L 2 ([0, T])}, 
Jo 

K v = {ge H{ : <p(t) = x+ f b(<p(s))ds+ f a(<p(s))g(s)ds}, 

Jo Jo 

and define 

T ( s \ \^ a eKj T {g{t)) 2 dt, <peH? 

hm = < (3-5) 
{ oo, <p £ fff 

By using the explicit expression of D~ l (x), we get the following for functions (p(t) whose pathes 

are completely contained inside S°. 



[<p{t) - b(<p(t))]D-\<p(t))W) - %(«))]' (3-6) 

n — 1 n — 1 

= Yl [m-H^mim-bMm^-Y.^)] 

i, 3 = 1, ij 1 3 k=l 



_ ^ {m - k{ V {t))) 2 
h ^(*) 

where ¥>„(*) = 1 " £"=i" W (*) • 

Lemma 3.2 If (p hits the boundary dS n , then I x {<-p) = 00 • 

Proof: We will prove this result by contradiction. Assume there is a ip such that I x {<-p) < 00 an d 
ip hits the boundary. Let to G (0,T] be the first time that ip hits the boundary. Without loss 
of generality we further assume that the hitting occurs on the first coordinate <p\. Now choose 
< t\ < t2 < to such that inf te [ tljt2 ]{&i(</?i(£))} > 0, and log(<^i(t)) is absolutely continuous on 
[^1,^2]- By direct calculation we get 

k ~k v»i(f) " Y 

On the other hand, performing integration by parts twice, we get 

-2 f 2 ^hM)l dt = -2{6 1 ( ¥ >(t 2 ))log( ¥)l (t 2 )) - 6 1 (^(ii))log(^i(ii)) 

\o^ x (t))Cp x (t) <ft} 
= -2{6 1 ( ¥ >(t 2 )) log(^i(i 2 )) - log^i^i)) 

+^[¥'i(*2)(log(¥'i(t 2 )) - 1) - ^(^Oaog^i^i)) - !)]}• 
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Letting ti goes to io , the above will go to infinity because the first term goes to infinity while 
all other terms are bounded. This certainly contradicts the assumption of finiteness of I x {<~p). □ 
Hence if we define Hg = Hf n C([0, T] , S°) , then 



/^) = J 5 io Ej=1 ^ * H ° (3.7) 

1 00, Lp £ 

Theorem 3.3 For any a; G 5°, £/ie family {P|} e> o satisfies a LDP on space C([0, T], <S n ) £/ie 
good rate function I x (-) and speed e 2 . 

Remark: If we introduce a map $ between spaces S n and A n such that 

*(a;i, • • = (zi, • • -,x n _ u 1 - ^ a;,-), 

and for simplicity, let {P|} e> o denote its image probability on space C([0,T],A n ) under the map 
then by contraction principle we have that for any x £ A°, the family {P|} e> o satisfies a large 

deviation principle on space C([0,T], A n ) with the good rate function I x (-) and speed s 2 . 

Proof: By Corollary 3.4 in Pukhalskii [10] and Lemma 3.1, it suffices to show that for every 

<pec x ([o,T],s n ), 



lim liminf e 2 logP|{ sup \x(t) - tp(t)\ < 6} (3.8) 
S^O e^O te[o,T] 

= lim limsupe 2 logP|{ sup \x(t) — <f(t)\ < 5} = —I x (cp). 
s^o e ^ te[o,T] 

First we assume that the path of ip is contained in S°. Choose So small enough such that 

B = {x(-) e C x ([0,T],S n ); sup \x(t) - <p(t)\ < 5 } c C x ([0, T], <S°). 

te[o,T] 

Then we have 

a = — inf d(x(t),dS n ) > 0. 

where d(y, <9<S n ) = inf^ e95n \y - z\. 
Define 

_ I <?(x), d(x,dS n ) > a 

a(x) = i 

I smooth and uniform Lipschitz continuous, else 

By replacing a(x) with (j(x), we define the diffusion x e (t), the law the matrix A(x), and 
the function I x (-) respectively. It is easy to see that I x {<~p) = I x ((f). By using Theorem 5.6.7 in 
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Dembo and Zeitouni [4] and Theorem 3.5 of Chapter 3 in Freidlin and Wentzell [8], we have for 
any f e C x ([0,T],S n ), 



lim liminf e 2 logP|{ sup \x(t) - f(t)\ < 5} (3.9) 

S^O e^O te[o,T] 

= limlimsupe 2 logP|{ sup \x(t) - f(t)\ < 8} = -I x {f). 

5^0 e^O te[0,T] 

Replacing / with ip in (3.9), we end up with (3.8) because the corresponding probabilities in 
both equations are the same for 8 < So. 

Now we are ready to prove (3.8) for paths that hit the boundary of S n . Let ip be such a path. 
The following is trivially true. 

lim liminf e 2 logP|{ sup \x(t) - <p(t) \ < 8} > -I x (<p) = -oo. (3.10) 

S^O e^O t£[0,T] 

On the other hand, let to > be the first time when ip hits the boundary. Then for any 
t G (0,to), <~p will not hit the boundary on [0,t]. By using an argument similar to that used in the 
derivation of (3.9) we get 

lim lim sup e 2 log P|{ sup \x(s) - (p(s)\ < 5} = -P x ((p), (3-H) 
8^o e ^o se[o,t] 

where I x {<-p) is the restriction of I x {<~p) on [0,t]. Hence 



lim lim sup e 2 log P x { sup \x(s) — ip(s)\ < 8} (3.12) 
s^o e ^o se[o,T] 

< lim lim sup e 2 log P x { sup \x(s) — ip(s) \ < 8} = —I x (ip). 
s^o e ^o se[o,t] 

From the proof of lemma 3.2, we get that Il((f) converges to infinity as t S to which implies 

lim lim sup e 2 log P x { sup \x(s) — tp(s)\ < 8} = — oo. (3.13) 
s^o £ ^o se[o,T] 

Lemma 3.2 combined with (3.10) and (3.13) implies that (3.8) holds for all ip £ C([0, T], S n ). □ 
3.2 LDP for Fleming- Viot Processes with Neutral Mutation 

The Fleming- Viot process with neutral mutation has many nice properties. One of them is called 
the partition property, namely, given any finite partition of the type space E = U^ =1 E tl then 
{X(t,Ei) : i = 1, • • •, K} is a finite dimensional diffusion process as in section 3.1.(cf. Ethier and 
Kurtz [7].) By using this property and the projective limit technique, we will establish a LDP for 
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the Fleming- Viot process with neutral mutation. This kind of result can be viewed as an infinite 
dimensional generalization of the Freidlin-Wentzell theory. In the remainder of this article we will 
have E = [0, 1]. 

Consider the following family of partitions of space E 

J = {{[0, h}, (t u t 2 ], ■ ■ ■ , (t ni 1]} : < h < t 2 < ■ ■ ■ < t n < 1; n = 1, 2, • • •}, 

with the same partial ordering y as in V of (2.12). It is clear that J C V . Thus we will denote 
generic element of J by t,j, etc., and for any i,j 6 J, the space X % and the mappings 7r tJ ,ir t are 
defined accordingly. 

By an argument similar to that used in Section 2, we can show that the projective limit of 
iTi 3 )i t3 £j is Mi(E) and projective topology is stronger than the weak topology but weaker than 

the r-topology. We will use M[ ro (E) to denote the space Mi(E) with this projective limit topology. 
Let Cj = C([0, T], X 3 ) be equipped with the usual uniform topology. For any j = {B\, • • • , B r } y 

i = {C\, • • • , C'i}, define a map p %3 between spaces C 3 and C t such that 

PtJ :C 3 ^C t , (x Bl {t),---,x Br {t)) -> ( J2 x B k {t)r--, J2 x B k i t ))- 

It is clear that p %3 is continuous, and for any I y j y t, p t £ = p tJ o py . Now let C be the projective 
limit of the family {(C t ,p tJ ); t, j G J} and p 3 : C — ► C 3 be the corresponding projection. Obviously 
C([0, T], M[ ro ([0, 1])) is a subset of C. On the other hand, let : J G J} be any element of C. 

Then for any t G [0,T], {^(t) : j G J} can be identified as a unique element fj,(t) of M[ ro (E) and 
thus : J G ^7} can be identified as /i(-). For any (a, 6] C -E, by the definition of projective 

limit, fj,(t)((a,b]) is continuous in t. Hence //(•) G C([0, T], M[ ro (E)) and C can be identified as 
C{%TlMl ro {E)). 

For any v G M\(E), let P®"<> v ° be the unique solution of the martingale problem associated 
with generator L in (2.15) starting at v. 

Definition 3.1 A probability measure v G M\(E) is called non- degenerate if for any j G J , k 3 (v) 
has no zero component. A path //(•) G C([0, T], M[ ro (E)) is called non-degenerate if for every t in 
[0,T], fj,(t) is non-degenerate. 

Remark: Any probability measure with support E is non-degenerate. 

Definition 3.2 A path //(•) G C([0, T], M[ ro (E)) is called absolutely continuous if for every i G J , 
7T 8 (/i) (t) is absolutely continuous as a multidimensional real valued function. 
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Theorem 3.4 For any non-degenerate v G M\(E), the family {P® ,1,iy °} satisfies a LDP on space 
C([0, T], M[ ro (E)) as j goes to zero with the good rate function 

= sup/^ (3.14) 

Remark: Let fj,(t) be a path of the Fleming- Viot process with neutral mutation. Then for every 
t > 0, the support of fj,(t) is a subset of the support of vq. Therefore the essential part of the type 
space is the support of vq. If we choose E to be the support of z/q, then the result still holds. Because 
of this we assume in the sequel, without loss of generality, that the support of vq is E = [0, 1]. 

Proof: Since the path of Fleming- Viot process is continuous in the r-topology (cf. Shiga 
[12]), we have that P^ 7 ^ {C([0, T], Mf°(E))} = 1. On the other hand for any j G J, by the 
nondegeneracy of z/, Theorem 3.3 and the remark following it, we have that p 1 (P® ,1,iy °) satisfies 
a LDP on space C 3 with the good rate function I qT ^{-). Applying Theorem 3.3 in Dawson and 
Gartner [3] we get the result. □ 

Let C 1,o ([0, T] X E) denote the set of all continuous functions on [0, T] X E with continuous first 
order derivative in time. For any v G Mi(E), //(•) G C([0, T], M[ ro (E)), define 

S v (fi(-))= sup {(/x(r),/(r))-(/x(0),/(0)) (3.15) 

/eC 1 '°([0,T]xB) 

- J (m(s), + A )f) ds - \ J o J J f( s , x ) f( s ,y)Q(A s )'i dx i d y) ds }i 

and 

fi u = {//(•) G C([0, T], M[ ro (E)) : /i(0) = z/, /i(-)is absolutely continuous, 
non-degenerate, and for anyj G J, (//)(•) G L 2 ([0,T])}. 

Remark: It is clear that = oo for any //(•) not in 7i u . 

The next theorem gives an variational form of the rate function 

Theorem 3.5 For any non-degenerate v G M\(E), and any //(•) G 7i u , we have 

I v (fi(-)) = S v (fi(-)). 

Proof: For any 

3 = {B 1 = [0,b 1 ),B 2 = [b 1 ,b 2 ),---,B n _ 1 = [6 n _i,l]} G J, 
and f(t,y) G C^^T] X E), let 6 = and 

7r j(/)(*,2/) = /(*,M> for y G -Bfc, /c = 0, • • • , n — 1. 
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Then from the absolute continuity of /i(-), we have 

\K s )' 7r j(f)( s )) ds = W T )^j(f)( T )) - (m(0)>Tj(/)(0)) - ^ T <M(s),^^(/)(s)>^s- (3-16) 
Approximating / by n 3 (f), we obtain the following result of integration by parts: 

f T (ll(s)J(s)}ds= (^T)J(T)} - </z(0), /(0)> - / T <M*), f(s)}ds. (3.17) 

Let x = n 3 {v). For A; = 0, • • • , n - 1, let Lp k (t) = p 3 (n)(t)(B k ) , (f(t) = ((fo(t), ■ ■ - ,Lp n -i(t)) and 
g(t, y) = (Lp k (t)—b k ( l +>(t))) 2 1 '<~Pk{t) for y & B k . Here rcorruptedrg(£, y) is well defined since //(•) is non-degenerate, 
and absolutely continuous. Then by direct calculation we have 



T /-T 

(fi(s),g(s))ds- / (/i(s),A#)cte 
Jo 

~^ / / / g(s,x)g(s,y)Q(fj,(s);dx,dy)ds (3.18) 

2 JO J£ J£ 

< sup {/ {fi(s),K 3 (f)(s))ds - (/i(s),A(7rj(/)))ds 

/GC'^flO.TDxB) JO JO 

~\ i i i 7r Af)( s ' x ) 7r Af)( s 'y)Q(M s )'i dx i d y) ds }i 

2 Jo Je Je 

where the inequality holds because g can be approximated pointwise by functions in the set {it 3 {f) '■ 
feC^i^TjxE)}. 
On the other hand, 

sup { / {(i(s),TT 3 (f)(s))ds- f {fj,(s),A(n 3 (f)))ds 

/6C 1 .°([0,T])xB) JO JO 

i r T , , 

^Af) ( s i x ) ^(Z) ( s i y) <2(M s ) ; dx i d y) ds ) 



2 Jo Je Je 



< sup / -&*(¥>(*)) ( 3 - 19 ) 

/eci,o([o,T])xS)^o fc=1 



z k,i=i 

..f n — 1 n — 1 

< / sup [V a k ((p k (s) - b k (<p(s)) - - V a fc _D fc /(^(s))a/]rfs 
= 4(¥>), 

which, together with (3.18), implies that 

hA^PM-))= sup {F (ii{s),TT 3 {f){s))ds- f T ((ji(s),A(n 3 (f)))ds (3.20) 

/GC'^flO.TDxB) JO JO 
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-Hi 

2 Jo Je Je 



^Af) ( s i x ) n Af) ( s i y) <2(M s ) ; dx i d v) ds )- 



By using the inequality 




and the expression (3.7) for I x ((f), we have that for any J2 >- Ji, 



Taking the supremum on both sides of (3.20) over the set J, we finally get 



WOO) 



sup {/ (fi(s),f(s))ds- (n(s),Af)ds 

/GC'^flO.TDxB) JO Jo 



~o / / / f( s i x )f( s iy)Q(f j '( s )i dx i d y) ds } 

2 Jo Je Je 




(3.21) 



where the last equality follows from integration by parts (3.17). 



□ 



Let C°°(E) be the family of all continuous functions on E possessing continuous derivatives of 
all order. For any linear functional ■& on space C°°(E), define 



where A* is the formal adjoint of A define through the equality (A*(/i),/) = (fj,,Af). 
We defer the proof of this theorem to Appendix. 

3.3 LDP for Fleming- Viot Processes with Selection 

Finally we turn to prove the LDP of the Fleming- Viot process with selection. The generator of the 
process is given in (2.16). We will assume that the fitness function V(x, y) is continuous on E® 2 in 
the sequel. 

For any v £ M^E), let P^> v >^ be the unique solution of the martingale problem associated 
with generator Cy started at v. For simplicity we will not distinguish between P®"<> v ° 1 p^f^ v ^o 




Then we have 



Theorem 3.6 For any non-degenerate v £ M\(E), and any //(•) in 7i u , we have 




(3.22) 
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and their respective restrictions on C([0, T], M[ ro (E)). By the Cameron-Martin-Girsanov transfor- 
mation (see Dawson [2]) we have that, restricted on C([0, T], M[ ro (E)), 

—fcy^ = Z V {T) = exp[-GV(M-))] > 0, (3.23) 

(I lp I 

where 



Gv(A-))= f f[f V(y,z)ii(s,dz)]M(ds,dy) (3.24) 
jo Je Je 

1 <- T 



c i i i i V(x,z)fj,(s,dz)][ V(y,z)fj,(s,dz)]Q(fj,(s);dx,dy)ds, 
2 Jo Je Je Je Je 

and M(ds, dy) is the martingale measure obtained from the martingale 

M t (cp) = ((i(t),<j>) - (MO), cp) - f\ii(s),A<j>)ds. 
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Let p be the Prohorov metric on M t (E), and C w ([0, T], M^ ro (E)) denote C([0, T], M^ ro (E)) 
equipped with the subspace topology of C([0, T],Mi(E)). For any «(■),/*(■) G C w ([0, T], M^ ro (E)), 
let 



Define 



te[o,T] 



R(fi,dx)= / [/ V(y,z)fi(dz)]Q(iJ,;dx, dy). 
Je Je 



Then we have the following theorem. 

Theorem 3.7 For any non- degenerate v £ M\{E), the family {_P^>"'> 1/ > i/ °} satisfies the following 
local LDP on space C w ([0, T], M[ ro (E)) as j goes to zero with the good rate function I v y{ji{-)): 

limliminf 7 log P^'^ {g(v(-), //(•)) < 8} (3.25) 
= lim lim sup 7 log P^'^ {(?(<;(•), //(•)) <S} = -L,v{»{-)), 

d-S>0 7 _j.o 

«?/iere 

(3.26) 

' ^H/i^-i?^^))-^^^))!!^^, if»(0) = v 
Iv,v{n{')) = ^ one? fi(-)is absolutely continuous, 

00. elsewhere 
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Remark: This yields the weak LDP, that is, the upper bound holds for compact sets only. 

Proof: Theorem 3.4 combined with Theorem 3.5 in [8], we have for //(•) £ C([0, T], M[ ro (E)), 

lim liminf 7 log P 6 *' 7 '* 70 : q(v(A, //(•)) < 5} (3.27) 



lim lim sup 7 log if™ {<; : q(v(-), »(■)) < 8} = -/„(//(•))• 

£-S>0 7 _j.o 



Let 



C= sup I / / / [/ V(x, z)fi(s,dz)][ I V(y,z)fi(s,dz)]Q(iJ,(s);dx,dy)ds\. 

l u(.)ec»([o,T],Mf r °(E)) Jo JeJeJe Je 

Since V is uniformly bounded, C is a finite constant. For any measurable subset B of space 
C w ([0, T], M[ ro (E)), by using (3.23), Holder's inequality, and martingle property, we get for any 
J- + i 



a>0,/3>0,i + i = l, 



Jb 

T 



<e^(/exp[- / " / ( / V(y,z)^(s,dz))M(ds,dy)]dP^' l/0 )^ a P^' l/ °{B} 1 ^ (3.28) 
J j Jo Je Je 

< e ^( 1 +")p^"'^o{ jB }i//3( y ^(T^if™) 1 /" 
= e #( 1 + a )p*.™>{£} 1 /0 

By choosing 5 = {v : £j(t>(-), //(•)) < 6} in (3.28), we get 

lim l limsup 7 logP^°{£K.),M-)) <S}< C{1 + a) - h^-)) (3.29) 

d-S>0 7 _!.o ^ P 

which implies (3.25) for paths that are not absolutely continuous. 

Let //(•) be an arbitrary absolutely continuous path in C w ([0, T], M[ ro (E)). For any fj, G Mi(E), 
let V{pi){y) = V(fJ,,y) = J E V(y, z)fj,(dz). Then we have 
i-T 



V(fi(s) 1 y)M(ds 1 dy) = (fi(T),V(fi(T))) - (/z(0), V(fi(0))) (3-30) 



, T ( M ( S ),(|- + A)y(M( S ))>^, 
OS 

which is continuous in //(•) in the topology generated by g. On the other hand 

V (/i, y)Q(fi'i dx, dy) = III V{x,zi)V{x,Z2)n{dzi)n(dz2)n{dx) 

e je Je Je Je 

V(x, zi)V(y, Z2) n(dzi) n{dz2) fj,(dx) n{dy) , 



which is also continuous in the topology generated by g. 
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Define 

iYGO) = {^(T),v(MT))) - mo), v(/z(o))) (3.31) 

-£W s ),(§; + A)V(Ms)))ds 

~\ I f f if V(x,z)n(s,dz)][ [ V(y,z)fj,(s,dz)]Q(fj,(s);dx,dy)ds. 
2 Jo Je Je Je Je 

Let B°(j2(-),S) denote the interior of B(j2(-),S). For any e > 0, we can choose 8 > small 
enough such that 

|liminf 7 logP^{B (/2(.),5)} + /,(/x(-))l<^ (3-32) 

7— »0 



limsup 7 logP^{B(/2(.),5)}+/ 1 ,(/x(-))| <£, (3-33) 

7->0 



/ T / y)M(ds, dy) - ({jl(T), V(fi(T))) - (p(0),V(p(0))) (3-34) 

rT (v(s) 1 (-?- + A)V(^s))}ds)\<s 1 



mV(n(s),x)V(n(s),y)Q(n(s);dx, dy)ds (3.35) 
_ E 

mV(p,(s),x)V(p,(s),y)Q(fj,(s);dx,dy)ds\ < e, 
_ E 



mV(n(s),x)V(n(s),y)Q(n; dx, dy)ds (3.36) 
_ E 

mV(fi(s),x)V(fi(s),y)Q(fi(s)-,dx, dy)ds\ < e, 
_ E 



rT 



(V((j,(s),x) - V((j,(s),x))(V((j,(s),y) - V(fj,(s),y))Q(fj,(s);dx,dy)ds\ < e. (3.37) 

Jo JeJe 
By (3.34)-(3.37), we get 



<exp{-[T v (fi(-)) + ^e]} 
i 1 
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X / exp{-[[ T f [f V(y,z)(fji(ds,dz) - fi(s, dz))]M(ds, dy)]}dP^^° 

Jb(ji(-),s) 7 Jo Je Je 

< exp{i[rY(M-)) + ^e]}P 9 ^{Bm,S)} l IP (3.38) 
7 1 

x(/"exp{ — [/ / [ / aV(y, z)(/j>(ds,dz) — jl(s,dz))]M(ds,dy) 
J 7 jo Je Je 



a 2 rT 



7 

Vm*),*)- WO,*)) 

2 Jo JE JE 

x{V{ l i{s),y)-V{n{s),y))Q{ l i{s);dx,dy)ds]}dP^^) lla 

= eX p{i[r v (M(-)) + ^e}}P 6 v ^{B{^.),5)ylP. 
7 ^ 

Together with (3.33) this implies 

lim limsup 7 logP^{B(/2(.),5)} < T v (»(•)) + - jM^-))- 

a-s-0 7 _!.o ^ P 

By letting e 0, then /? — ► 1, we get 



lim limsup7logP^™>{fl(/z(-),5)} < MMO) ~ I» (»(•))• (3-39) 

£-S>0 7 _j.o 

By an argument similar to that used in the derivation of (3.38) and Holder's inequality we get 

P e v ^{B°( i i(-),S)}= ( eM-Gv(^))}dPt^° 

Jb'(p(-),s) 7 

> exp{i[rV(M-)) " U} 
7 2 

x ' / III Min, -?\(,,(A A -A— r,(c A -?\\~\ 1\/T i A o An,X\\A P e .7^o 



ex P{-[/ /[/ V(y,z)(fi(ds,dz) - fi(s, dz))]M(ds, dy)]}dP° 
7 Jo Je Je 



exp{ — [ / / ( / V (y, z)(ji(ds, dz) — /i(s, dz)))M(ds, dy) 
7 Jo Je Je 



>b°0i(.),5) 
>exp{i[r v (M(-))-(^ + ^]} 

x ' 

lB«(p(-),8) ' ^7 

x(V(fi(s),y) - V(fi(s),y))Q(fi(s);dx, dy)ds]}dP^ 
> exp{i[r v (M(-)) - (| + ^)^}^°{ J B°(M(-)^)} /3 (3-40) 

x(/ exp{i[/ / [/ -yV(y,z)(+i(ds,dz) - fi(s,dz))]M(ds,dy) 

J 7 JO JE JE P 

a 2 ^ 



2p z Jo Je Je 

x(V(fi(s),y) - V(ii(s),y))Q(fi(s);dx, dy)ds]}dP^)~^ 
exp{i[rV(M(-)) - {\ + ^)e}}Pt^{B°m,S)Y, 
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which, combined with (3.32), leads to 

lim iliminf 7 logP^{B°(/2(-),5)} > T v (»(•)) - (| + ^-)e + 
By letting e 0, then (3 — ► 1, we get 



lim liminf 7 logP^{B (/2(-),5)} > IV(/z(.)) - /„(//(•))• (3-41) 
The equalities in (3.25) will follow if we can show that for absolutely continuous path /i(-), 

h,v(M-)) = -rv(M-)) + iAM-))- (3-42) 

By direct calculation we have 

E(M-)) - MM-)) = {(/i(r), /(r) - v(/z(r))) - ( M (o), /(o) - f(/x(o))) 

/eCLUflO.TlxB) 

" Am*), (|- + A)f - V(fi( S ))) + (R(fi( S )),f( S ) - V(fi( S )))] ds (3.43) 

JO OS 

2 Jo Je JE 

sup {(,x(r),/(r))-(/x(o),/(o)) 

" / Q T[<M(S) ' ( ^ + A)f) + < i? (^( S ))' rfS 

2 Jo Je Je 
which leads to (3.42). 

Finally by (3.42), we get that the level sets associated with I v y{ji{-)) are compact. □ 
Acknowledgements. We thank an anonymous referee for comments and suggestions that helped 
improve the presentation of this paper. 



Appendix 

The proof of Theorem 3.6: 

For any / in C 1,o ([0,T] X E), and //(•) in 7i u , we have that 



(^T)J(T)} - </z(0), /(0)> - / T (mW, + A)f) du 
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~\ I II f(u,x) f(u,y)Q(fj,(u);dx,dy)du 
2 Jo JE JE 

(fi(u) - A*(fj,(u)), f{u))du-\ I I I f(u,x) f(u,y)Q(fj,(u);dx,dy)du 

l Jo JE JE 

~ Io ~ A *(M u ))\\n(u)du, 

which, together with Theorem 3.5, implies that 

IAM-)) < [M u ) ~ A*(Mu))\\,(u)du. (A.l) 

We next show that 

IAM-)) > jfW) ~ A*(Mu))\\,(u)du. (A.2) 
Since v is non-degenerate and //(•) is in 7i u , we have that 

iAM-)) = SAM-))<oo. 

For any [s,t] C [0,T], and any / in C 1 '°([s,i] X E), let 

IsAf) = (v(t)J(t)) ~ (»(s),f(s)) ~ J\»(u), (^ + A)f)du. 

Let 

L 2 ([s, t] X E) = {/ : / / f 2 (u, x)fj,(u, dx)du < oo}, 

Js JE 

and L is the linear subspace of L 2 ([s, t] X E) of all functions which are constant in space variable x. 
Let L 2 ([s, t]xE)/Lbe the quotient space of L 2 ([s, t]xE) module L. We introduce on L 2 ([s, t]xE)/L 
the following norm 

f 1 l l 2 

I h{u,x)h{u,y)Q{n{u);dx,dy)du> , 

E JE J 
and the inner product 

{h\,h2) = III hi(u,x)h,2{u,y)Q(n(u);dx,dy)du. 
Js JE JE 

It is not hard to check that space (L 2 {[s, t] X E)/L, \ \ ■ \ |) is a pre-Hilbert space. Let C 2 ([s, t] X E) 
be the completion of space L 2 ([s,t] X E)/L (cf. for existence refer to page 56 of Yosida [15]). Then 
(£ 2 ([s,£] X E), || • ||) becomes a Hilbert space. 

Let £^ ub ([s,t] X E) denote the closure in £ 2 ([s,£] X E) of the linear span of the set C 1,0 ([s,£] X 
E). By an argument similar to Dawson and Gartner [3] on pages 277-280, and the Hahn-Banach 
Extension Theorem (cf. page 106 of Yosida [15]) we have that l s<t is a bounded linear functional 
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on £^ ub ([s,t] X E). Thus by the Riesz Representation Theorem, one can find a function h in 
£L&([°> T ] x E ) such that 

h,t(f) = f f f f(u,x)h(u,y)Q(n(u);dx,dy)du, (A. 3) 

, ^/ / f(H u i x )-f( u i x ))(H u iy)-f( u iy))Q(f i ( u )i dx i d y) du = {:) i ( A - 4 ) 

5V (MO) = 77 / / / h(u,x)h(u,y)Q(fi(u);dx,dy)du, (A. 5) 

which implies that 

T /-X 

\\fi(u) - A*(fi(u))\\ (u) du = / sup {(AM - A*, 5) 

JO g£C°°(E) 

-t: / / g( x )g(y)Q(A u )'i dx ' d y)} 

sup {(AM - A*, f(u)} - (n(u)J(u)} 
o /ecLOdo.xjxS) 

~\ / / f( u ' x )f( u iy)Q(M u )'i dx ' d y)} 

= ^(m(-))-77 , inf n / / f (h(u,x) - f(u,x))(h(u,y) - f(u,y))Q(fi(u);dx,dy)du 
2 fec 1 >°([o,T]xE)Jo JeJe 

= -MM'))) 

where (A. 3) is used in deriving the third equality, and (A. 4) and (A. 5) are used in reaching the last 
equality. This together with Theorem 3.5 implies (3.22). □ 
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